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'  In  decision  theoretic  approaches  to  estimation  problems,  loss  functions 

■**  *  ot 

of  the  type  L(0,0)  =  |0-0|,,  a  >  0  are  often  employed often  a  =  2.  In 
many  applications  of  reliability  and  life  testing,  such  loss  functions  are 
inappropriate.  Alternative  loss  functions  which  appear  to  be  more  suited  to 
the  intended  application  are  proposed  and  Bayesian  estimates  of  the 
exponential  parameter  are  obtained  for  these. 

Asymptotic  expansions  of  such  estimators  are  given  and  compared  with 
estimators  given  in  the  literature. 
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SIGNIFICANCE  AND  EXPLANATION 


This  report  studies  the  sensitivity  of  reliability  estimates  to  changes 
in  the  loss  function.  The  choice  of  loss  function  is  an  important 
consideration  in  assessing  the  merits  of  an  estimator,  since  this  embodies  the 
concerns  of  the  applier  in  terms  of  those  errors  of  estimation  for  which  he 
would  like  to  insure  the  greatest  protection. 

The  sensitivity  is  examined  by  means  of  asymptotic  analyses  which  permit 
one  to  ascertain  readily  the  deviations  from  the  maximum  likelihood  estimator. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  authors  of  this  report. 
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SENSITIVITY  AND  ASYMPTOTIC  PROPERTIES  OF 
BAYESIAN  RELIABILITY  ESTIMATES 


Bernard  Harris 
& 

Andrew  P.  Soms 


1 .  INTRODUCTION 

In  decision  theoretic  approaches  to  estimation  problems,  the  error  of 
estimation  is  typically  measured  by  loss  functions  of  the  form 

L(e,e)  =  !e-§|v,  v  >  o  , 

where  6  is  the  unknown  parameter  and  0  is  the  corresponding  estimator. 
However,  as  the  following  heuristic  argument  will  demonstrate,  such  a  loss 
function  is  oten  inappropriate  for  many  applications  of  reliability  and  life 
testing. 

Let  R,  0  <  R  <  1,  be  the  reliability  of  some  device.  If  R  is  an 
estimator  of  R  and  the  true  value  of  R  is  .5,  then  an  error  of  the  magnitude 
| ft- R |  =  .1  would  be  unlikely  to  affect  any  administrative  decision  concerning 
the  feasibility  of  the  device,  since  a  device  whose  reliability  is  between  .4 
and  .6  would  not  usually  be  regarded  as  satisfactory.  On  the  other  hand,  if 

A 

R  =  .90,  then  one  device  in  ten  fails  and  the  estimate  R  =  .99  would  suggest 
that  only  one  device  in  100  would  fail.  Thus,  one  might  be  inclined  to  conclude 
that  one-tenth  as  many  replacements  were  needed  as  were  in  fact  required  and 
consequently  seriously  misjudge  maintenance  and  replacement  costs.  A  similar 
but  opposite  error  in  judgement  occurs  when  R  =  .99  and  R  =  .90.  Consequently, 
it  appears  to  be  desirable  to  concentrate  on  errors  of  estimation  for  R  close 
to  unity. 

Sponsored  by  the  United  States  Army  under  Contract  No.  DAAG29-80-C- 
0041  and  the  Office  of  Naval  Research  under  Contract  No.  N00014-79- 
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Considerations  such  as  those  described  above  suggest  that  loss  functions 
suitable  for  reliability  applications  might  have  forms  such  as 

L(R,A)  =  iR-R]V/(l-R)<,  OsR<l,  OsR<l,  v>0,  k>0, 
or 

i  i  !v 

L(R.R)  =  tTr  -  iTftl  »  OsR<l,  OsR<l,  v>0. 

In  order  to  study  the  effects  of  using  such  loss  functions,  we  consider 
a  Bayesian  model  for  exponential  life  testing  and  examine  the  asymptotic  behavior 
of  the  estimates  thus  obtained. 

Specifically  let  * . - • » be  independent  identically  distributed 

observations  from  an  exponential  distribution  with  probability  density  function 

f(x;9)  «  9  e'9x,  x  >  0,  9  >  0.  (1) 

Then  the  reliability  Ry  is  defined  as 

Rt  *  e'8T  ,  (2) 

where  T  >  0  Is  a  constant  assigned  in  advance  of  the  experiment  and  known  as 
the  mission  time.  With  no  loss  of  generality,  we  can  set  T  =  1 ,  since  this 
corresponds  to  selecting  the  scale  with  respect  to  which  the  observations 
X-| ,%2*‘  •  •  »Xfj  are  measured. 

In  Section  2,  we  obtain  Bayesian  estimators  for  specific  loss  functions 
of  the  type  described  previously,  when  R  has  a  beta  distribution  prior.  We 
compare  this  with  the  Bayesian  estimator  of  R  that  is  obtained  by  assigning 
a  gamma  prior  to  9,  a  choice  of  Bayesian  model  quite  often  found  in  the 
literature.  Obviously,  since  R  is  a  function  of  9,  this  induces  a  prior 
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on  R;  however,  the  priors  assigned  to  9  in  such  studies  do  not  induce  the 
beta  family  of  priors  on  R. 

In  Section  3,  the  asymptotic  behavior  of  these  estimators  is  given.  These 
asymptotic  expressions  facilitate  studying  the  sensitivity  of  the  estimators  to 
the  changes  in  the  loss  functions. 

Section  4  is  devoted  to  comparing  the  results  obtained  herein  with  previous 
estimation  techniques. 

Several  appendices  which  provide  the  technical  details  needed  to  establish 
the  existence  of  the  estimators  and  the  calculation  of  the  asymptotic  expansions 
are  included  at  the  end  of  the  paper. 


2.  BAYESIAN  ESTIMATION  FOR  UNCENSORED  AND  TYPE  II  CENSORED  DATA 

Let  j  <  5  ***  s  X^j  be  the  order  statistics  from  a  random 

sample  disbributed  by  (1).  Assume  that  only  the  first  n  order  statistics 
have  been  observed,  1  <  n  <  N.  Then,  it  is  well-known  that  the  total  time 
on  test  statistic  Y,  defined  by 

Y  •  «(1)  *  (*-")X{B)  (3) 

is  a  sufficient  statistic  and  its  probability  density  function  is 

fY(y;0)  =  8n  e'9y  yn'1/r(n),  y  >  0,  e  >  0.  (4) 

To  represent  (4)  in  terms  of  the  reliability  R,  we  reparametrize, 
obtaining 

fY(y;R)  =  (-log  R)n  Ry  yn_1/r(n),  0  <  R  <  1,  y  >  0.  (5) 

Let 

t(R;ci,B)  =  Ra_1  (1-R)M,  Q  <  R  <  1  ,  a  >  0,  6  >  0,  (6) 

be  the  prior  distribution  on  R.  Then  the  joint  distribution  of  R  and  Y 
is  given  by 

f{y,R;a,B)  =  r(a)r(f)rjn)  O-R)8'1  (-log  R)n  yn-1  ,  (7) 

0<R<1,  0  <  y,  a  >  0,  3>0,  1  <  n  s  N  . 

8  1 

We  now  obtain  the  marginal  distribution  of  Y.  Expanding  (1-R)P*  in 
a  binomial  series,  we  obtain 


f-j(y;a,B)  =  r(a)r(B)r(n) 


aa+y-l 


(-log  R)n  l  (6T1)(-l)iRidR. 
i  =0  1 


In  (8),  it  is  understood  that  if  B  is  a  positive  integer,  the  series 
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terminates;  that  is,  all  terms  with  i  >  6  -  1  are  zero. 

The  interchange  of  summation  and  integration  in  (8)  is  justifiable. 
Hence,  we  can  write  (8)  as 


;<»»•«  *  1  /V^-'c-log  .)"  dR 

l  “U  0 


oo 

rfct+B)  ..n-l  y  /  f"n. 

-  r(a)rfe)r^)’  y  ^  H)  (  i  }  Jo  6  ' 


-6(a+y+i ) 


d0 


r(a+8)  n-l 
=  r(a)r($)r(n)  y 


oo 


l 

i  =  0 


r(n+D 

(a+y+i )n+^ 


■Mr^'  j0  «9> 

In  particular,  the  integration  given  in  (9)  is  valid  over  a  larger  range  of  the 
parameters  than  specified  in  (7).  Specifically 


Ra+y-]  (1-R) 6-1  (-log  R)n  dR  =  (-UV:1)  ('2y^nTf  -  HO) 

whenever  a+y>0,  6  +  n  >  0.  These  facts  will  be  subsequently  utilized. 

The  reader  is  referred  to  Appendix  I  for  various  details  relevant  to  these 
remarks  and  calculations. 

Some  particular  cases  of  (10)  are  worth  noting.  If  6=0,  we  have 
ri 

J  R01^"1  (1-R)"1  (-log  R)n  dR  =  r(n+l  k(n+l  ,ct+y)  (11) 

Jo 

where  c(r,s)  denotes  the  generalized  Riemann  zeta  function  and  r,{ r,l)  =  c(r) 
is  the  Riemann  zeta  function. 

Combining  the  results  of  (7)  and  (9),  we  can  write  down  the  posterior 
distribution  of  R  given  Y  =  y  as 
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f(R|Y=y) 


R^"1  Q-R)B"1{-1oq  R)n 

r(n+i)  i  M)i(e:1)/(«+y+On+1 

1=0 


(12) 


This  enables  us  to  calculate  the  Bayes  estimators  for  a  number  of  the  loss 
functions  of  the  type  described  previously. 

For  L-|(R,R)  =  (R-R)2,  the  Bayes  estimator 


I  Ra+y  (1 -R)B_1 (-log  R)"  dR 

4 _ 

f  Ra+y_1  (1-R)B_1  (-log  R)ndR 


Ra,6(V  =  E(Rly=Y)  = 


(13) 


or  equivalently. 


Vs'V 


l  (-llVl'l/la+ytHl)"*' 

i  =0 _ _ _ 

l  )/(c+y+1 >n+1 

i=0  1 


(14) 


In  particular,  for  B  =  1 


R  q(L,)  =  (1  -  -~t) 
a, 3  r  v  a+y+1 ' 


n+1 


(15) 


Similarly,  for  V(R,R)  =  ( R-R)2/(l ~R)V  ,  v  >  0,  the  Bayes  estimator 


is 


a,3,v'  2 


(U)  = 


E{R/(1-R)V| Y=y) 
EO/(l-R)v[Y=y} 


(16) 


or 
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VB,v‘V  -J=S - — — : - —  •  6-^>0  •  <17> 

I  (-OVT  ) 

1=0  1 

Finally,  we  consider  the  loss  function  L3(R,R)  =  ((1-R)-1-(1-R)-1 )2.  Here 
the  Bayes  estimator  Is  given  by 

Vb{L3}  =  1  "  (EtO-R)'1  |Y=y})“1  .  (18) 

Since 


E{ (1 -R) _1 | Y-y }  = 


f  R^y-Vl-R)6-2  (-log  R)n  dR 

A _ 

r(n+l )  l  (-l)f(B:')/(aty+i)"+1 
■i  =n  1 


(19) 


and  since  the  integral  (19)  converges  whenever  B  +  n  -  1  >  0  ,  we  have 


E{ (1-R) _1 | Y-y }  » 


I  (-l)V;2)/(aty+1)n+1 


1=0 


I  (-l)i(BT1)/(a+y+i)n+1 
i=0  1 


(20) 


Then,  we  can  write 


l  (-l)i(e;2)/(a+y+i)n+'  -  l  (-1 )T(PT* )/(a+y+i ) 
i=0  1 _ 1=0  1 

l  (-^(^/(a+y+i)"*1 
i=0 


.,n+l 


i/6-1 


Vs'V  ■' 


.  xn+l 


.  (21) 


Applying  the  Pascal  triangle  identity,  we  have 
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J  (-1 )i_1 (flf )/(a+y+i  )n+1 

0,6  3  l  (-1)V:2)/(a^i)n+1 

i=0  1 

l  (-l)i(B:2)/(a+y+1+l)n+1 
_  _i^0 _ 1 _ 

l  (-l)i(S:2)/(a+y+i)n+1 
i=0 

Comparing  (14),  (17)  and  (22),  we  have 


(23) 


(24) 


Thus,  we  have  shown  that  the  three  families  of  estimators  have  the  same 
form.  Hence,  it  is  possible  to  study  all  of  them  simultaneously  and  a  single 
asymptotic  expansion,  given  in  the  appendix,  permits  simultaneous  analysis  of 
their  asymptotic  properties. 

One  caution  should  be  noted.  We  have  listed  the  posterior  means  whenever 
the  posterior  means  exist.  However,  in  some  of  these  instances  the  Bayes  risk 
will  be  infinite.  Specifically,  for  the  loss  function  L the  Bayes  risk 
exists  whenever  8  +  n  -  2  >  0. 

In  the  statistical  literature,  one  frequently  finds  the  following  Bayes 
estimator  of  R  (see  for  example,  N.  R.  Mann,  R.  E.  Schafer,  N.  D.  Singpurwalla 
[6],  p.  398).  This  is  the  estimator  obtained  by  using  the  loss  function 
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A 

L-|(R,R)  and  assigning  a  gamma  distribution  prior  to  a,  the  parameter  in  the 
exponential  density  (1).  A  brief  sketch  of  the  calculation  of  the  estimator 
follows.  The  prior  is  given  by 

t(0:Y,6)  =  <SY  0Y_1  e‘6e/r(Y5  ,  (25) 


where  6,Y  >  0  and  6  >  0.  Then,  calculating  the  posterior  distribution  of 
0,  when  the  data  is  given  by  the  total  time  on  test  statistic  (3),  it  follows 
that  the  estimator 


R(Y,6) 


Vs+i 


n+  y 


(26) 


the  conditional  expected  value  of  R  given  Y  =  y.  Subsequently ,  this  will 
be  compared  with  (14),  (17)  and  (22). 


Remark.  To  the  authors,  one  of  the  more  interesting  properties  of  these 
estimators  is  the  role  played  by  the  Riemann  zeta  function  and  the  generalized 
Riemann  zeta  function.  From  (11),  we  have  that 


Ra,0^1 )  =  ^n+1’  a+y+l )  /  C(n+1  ,a+y) 


^a,6,6^L2^  =  ^a,l^L3^  * 


Further,  from  (21),  we  see  that 

Raj0-3)  =  U(n+l,a+y)  -  (a+y)“n~1 )  /  ra(n+l  ,a+y) 
and  i f  a  =  1 ,  y  =  0, 


R1,1(L3)  =  U(n+1)  -1)  /C(n+1)  . 
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Specifically,  if  in  addition  n  =  1, 

ftlfl(L3)  =  (tt2/6  -  1 )  /  (h2/6)  =  i  -  -i-  . 

We  conclude  this  section  with  some  observations  concerning  elementary 
properties  of  the  estimators  given  by  (14),  (17)  and  (22).  With  no  loss  of 
generality,  we  can  examine  specifically  (13)  and  (14).  From  (13),  it  is 
immediately  evident  that  0  <  R  <  1.  We  now  show  that  R  is  an  increasing 
function  of  a  (or  y)  and  a  decreasing  function  of  8,  which  one  would 
naturally  expect  to  be  the  case,  given  the  respective  roles  played  by  a  and 
8  in  the  model.  Therefore,  we  calculate 


3R 

38 


f  Ra+y(l-R)B_1  log  (l-R)(-log  R)n  dR 
Is - 

|  Ra+y-l (l-R)6-1  (-log  R)"  dR 


oa+y( i _p)8-l  (_log  R)"dR  j  (l_S) (-log  S)n  dS 


f  ca+y-l  _c  ^8-1  ■ 

Jo 


ff  Ra+y-l  (1  _R)e -1  (-log  R f  dR]/ 


Thus,  it  suffices  to  consider 


f  Ra+y  (1-R)B_1  log  ( 1 -R) (-log  R)n  dR  f  Sa*y'] (1-S)B_1 (-log  S)n  dS 


f  R“*y  (l-R)8"1 (-log  R)n  dR  f  sa*y"'(l-S)6",log(l-S)(-log  S)"  dS 


[  [V+y  (l-R)8_1(-log  R)n  s^d-S)8"1  (-log  S)n 

'o  ■'o 


log (l-R) -log (1— S) 


dBdS, 
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3.  ASYMPTOTIC  COMPARISONS  OF  ESTIMATORS 

From  the  results  of  Appendix  III  (see  A. 82),  we  have  that 


<h>“ 


<«4> 


(B-1)e~y^ 

ny2(l-e_1/^)  0  -  , 


(L 


2.v 


) 


(B-v-1 )e 

ny2(1-e'1/y)(1  -  4)  > 

ny 


Ra,B<L3> 


.i  +  4 

y  ny 


-(otti) 


(B-2)e'1/y 

ny2(l  -e"1^) 


(1  •  ^  • 


(27) 


(28) 


(29) 


As  is  evident  from  the  above,  the  differences  are  small.  For  large  n. 


Ra,|3(Ll)/R(a,8) (L2,^)  ~  1  + 


ve 


■1/y 


ny2(l-e_1/*) 


(30) 


and  in  general  R(a>0)(Li)/Ra>g(Lj)  ~  1  +  0(n_1).  1  s  i,  j 
Naturally,  since  the  maximum  likelihood  estimator  is 
the  estimators  above  to  be  asymptotically  equivalent  to  it. 


<  3. 

•1  /v 

e  %  one  expects 
Note  further  that 


ve"^/y2(l-e”^) 

is  bounded  for  all  y  >  0. 

Similarly,  for  the  "traditional"  Bayesian  estimator  (26),  the  comparable 
representation  is 

_  I  _  -I_  +  26+1 
r(y,s)  ~  e  y  n?  nyJ 


(31) 
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and  R(Y,6)/R  Jt.)  =  1  +  0(n-1),  i  =  1,2,3.  Thus,  it  appears  that  the 

Ct  j  p  1 

differences  are  about  as  small  as  could  reasonably  be  expected. 
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4.  SOME  PROPOSED  ESTIMATORS  OF  R 

The  minimum  variance  unbiased  estimator  of  R  has  been  studied  by 
E.  L.  Pugh  [8],  A.  P.  Basu  [2]  and  S.  Zacks  and  M.  Even  [12].  In  our  notation, 
this  is  given  by 


* 

R 


(  1  -  l/ny)"'1 


0 


ny  >  1 
ny  <  1 


★ 

The  asymptotic  representation  for  R 


is  easily  seen  to  be 


(32) 


I  +  _L  -L  - 

R*  =  e*  2n*2  (1  ♦  0(n-2))  . 

We  can  also  adapt  the  estimators  of  the  exponential  parameter  given  by 
G.  M.  El-Sayyad  [4]  to  correct  them  in  a  naive  manner  to  reliability  estimators. 
Naturally,  the  optimality  hypotheses  used  therein  no  longer  apply. 


1*  =  exp 


(r(n-p)/r(n-2p)} 


ny 


1/Ps 
)  ’ 


p  >  0 


_  1  _  / 3p+l  \ 

=  e  y  (1  +  O(n-Z)) 


(33) 


(34) 


El-Sayyad  also  provides  an  argument  which  leads  to  the  well-known 
estimator 

0  =  e^nVny  , 

where  ( n )  is  known  as  the  Psi  function  or  di gamma  function.  Fron  this,  one 
deduces 

r  s  ee*(n)/ny  (35) 

and  from  well-known  asymptotic  properties  of  ip(n),  (see  for  example, 

M.  Abramowitz  and  I.  A.  Stegun  [1]), 
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1-1 

R  =  2n*(l  +  0(n-2)  )  .  (36) 

The  Psi  function  arises  naturally  in  estimators  as  the  scale  transformation 
invariant  estimator  for  squared  error  loss,  in  this  connection  see  t.  s.  Ferguson  [5]. 

El-Sayyad  also  obtained  some  Bayesian  point  estimators  for  the  exponential 
parameter  using  the  gamma  prior  and  some  loss  functions  which  are  generalizations 
of  the  squared  error  loss  function. 

In  the  notation  of  (ci),  his  estimators  for  9  are 

^  =  (6+ny)"1  {r(Y+n+a+6)/r(Y+n+e)}1/6  (37) 

and 

e2.e*'("tYWny).  (38) 

where  a, 8  are  nonnegative  parameters  in  the  loss  functions  used  by  El-Sayyad. 

These  yield  estimators  of  R  as  follows, 

A 

-  -Qi 

R.  =  e  ,  i  =  1 ,2  (39) 

and  asymptotically,  we  have, 

1  YK*  (8-1  )  +  _JL 

R,  =  ,-y  "?  '  2"?  "y!  (,  *  0(n-2)),  (40) 

and 

,1.x.  J_  « 

jj2.e?  "J  SFa+ota'2)).  (41) 

Various  Bayesian  estimators  for  the  exponential  parameter  were  suggested 
by  S.  K.  Bhattacharyya  [3].  In  one  of  these,  he  considered  the  range  of  x  =  1/0 
to  be  finite  and  used  the  uniform  prior 
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g(t)  = 


(B-a)-1 , 


0  <  a  <  t  s  B  » 

otherwise. 


(42) 


He  also  considered  the  inverted  gamma  density 

v+l 


-V/T  (H.) 

g(T)  =  e - 1 -  ,  0  <  T  <  «,  v.v  >  0. 

y  r(v) 


(43) 


Letting 


Y( 


A 

n »x )  =  |  e  tn  1  dt  , 


the  Bayes  estimate  for  (42)  is 


d  ,  Y* (n-1 tny+l ) 
K?  * 


3  Y*(n-l,ny)  (1  +  1/ny)11”1 


(44) 


where  Y*(n,v)  =  Y(n,^)  -  y  (n,  tt) 

a  p 


For  the  prior  density  given  by  (43),  the  Bayesian  estimator  was  shown 


to  be 


-n-v 


(45) 


which  asymptotically  behaves  like 


.1  . 

8  =  ey  np  2«r  '  ny  (]  +  0(n-2}) 


1  +  4 


(46) 


He  also  calculated  the  Bayesian  estimator  for  the  exponential 


17 


prior  obtaining. 


(n-l) 

2 


(47) 


where  the  prior  is  given  by 


g(-r)  =  X-1  e"T^X 


0  <  t  <  00  ,  X  >  0 


(48) 


It  can  be  shown  that  (47)  may  be  approximated  by 


-(n-l) 


(49) 


for  large  n.  Formula  9.7.8  p.  378  in  M.  Abramowitz  and  I.  A.  Stegun  [1] 
may  be  used  to  obtain  more  detailed  asymptotic  information. 

In  the  papers  by  S.  K.  Sinha  and  I.  Guttman  [10].  [11]  the  improper  prior 

g(x)  =  t”  ,  0  <  x  <  00  (50) 

is  assigned  to  x  =  1/0,  obtaining  as  the  Bayes  estimator 

R  -  (1  +  l/nyfn  ,  (51) 

which  yields  the  asymptotic  expression 

.1  .  -L- 

R  =  e  *  ’  2n*2  0  +  0(n'2))  .  (52) 

V.  M.  Rao  Tummala  and  P.  T.  Sathe  [9]  employed  gamma  priors  and  obtained 


"minimum  expected  loss  estimators"  for  the  reliability.  They  compare  these 
estimators  with  the  Bayes  and  maximum  likelihood  estimators  for  quadratic 
loss  functions  in  estimating  0  . 
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APPENDIX  I 

In  this  appendix,  we  study  the  series  given  in  (9)  and  establish  the  re¬ 
marks  following  (9)  and  (10).  This  can  also  serve  as  a  justification  for  the 
interchange  of  operations  used  in  deriving  (9).  Specifically,  we  establish 
the  following 

Theorem  A.l .  Let 

i(a,8,x) 3  I  (-i)1(B:1)(“+i)'{T+1)-  (AJ) 

i=0  1 

where  a  >  0,  and  r  and  8  are  real,  and  where 

(e-lKf  2)  "•  (e-i)/i!  i  =  1,2,... 

(V)  ■■ 

I  ,  i  *  0  .  (a. 2) 

s 

Then  I(a,8,x)  converges  whenever  8  is  a  positive  integer.  If  8  is  not 
a  positive  integer,  l(a,8,x)  converges  if  and  only  if  8  +  x  >  0. 

Proof.  Clearly,  if  8  is  a  positive  Integer,  the  series  (A.l)  terminates 
and  convergence  Is  trivially  verified.  Hence  assume  that  8  is  not  a 
positive  integer.  Write 


l(o,8,x)  «  l  (ej1)(-l)1(a+i}‘^T+1) 

i<8  1 

+  I  (0:1)(-l)1(a+1)“(T+1)  .  (A.3) 

i>8  1 

The  first  sum  has  a  finite  (possibly  zero)  number  of  terms.  Hence,  to  study 
convergence,  it  suffices  to  restrict  attention  to  the  second  sum,  which  we 
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write  as 


where 


l 

isg 


Y(Y+1 ) • • -(Y+i-r)(a+i)“^T+1 ^  , 

i! 


(A  A) 


r  =  1 ,  Cg  =  1 ,  Y  =  1-8,  if  8  <  0 

r=[8]+l,  C3  =  (-1  )r_1  (0-1 )  •  - -(0-r+l ) .  Y  =  (r-8)  if  3  >  0  -  (A.5) 


Further,  in  (A. 4),  vacuous  products  are  interpreted  as  unity  and  y  is  always 
positive. 

Ue  now  determine  when  (A. 4)  converges  and  obtain  estimates  for  the  tail 
of  (A. 4),  when  it  is  convergent.  Hence,  it  suffices  to  consider 


IM<a,Y,r,,>  .  I  Y(Y+l>'-'(^;-r)(‘,+i>-;T*')  , 

"  i >M  1 ! 


(A. 6) 


which  has  all  terms  positive.  Note  that  the  sign  of  (A. 4)  is  determined  solely 
by  C6. 

Now 


log 


(a+i)'(T+1) 


< 


(Y+i-r)log(Y+i-r)-(Y+i-r)-ylog Y + Y +  ^  log[(Y)(Y+i-r)] 

-(t+1  )log(a+i )  -  i  log  i  +  i  -  j  log  i  -  ^  log  (211) 

=(Y+i-r)[log  i  +  log  (1  +-^-)]  +  r  -  Y  log  Y  +  ^  log  Y  +  ^log  i 

+  ^  log(l  +^-)-(t+1  )log  i  -  (x+l)log(l  +  j)  -  i  log  i 

-  \  log  i  -  \  log(2n).  (A. 7) 
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For  M  sufficiently  large,  we  have  for  all  i  >  M, 

1  <  (1  4  If)  s  e 

and 


1  <  0  +  f)  <  f  • 


Thus, 


,1 


7  <vj)|  (o.n)-('+’>/i! 

,j*0 


where 


d(x) 


-(t+1  ) 


r  >  -l 

T  <  -1 


Therefore,  we  have  shown  that 


I 


c  l 
i  >M 


> 


for  some  positive  constant  c  =  c(Y,r,T).  From  (A. 10),  we  can  immedfately 
observe  that  IM  converges  absolutely  whenever  Y-r-x<0.  Thus,  from  (A. 5). 
we  have  that  if  0  >  0,  l(a,0,x)  converges  whenever  S+x>0.  Similarly,  i 

6^0,  the  same  conclusion  holds. 

To  establish  the  converse,  note  that 


log 


(ct+i ) 


-(t+1) 


> 


(A. 8) 


(A. 9) 


(A. 10) 


f 


(Y+i-r)[log  i  +  log(l  +  -y-)]  +  r-  Y  log  y  +  j  log  Y  +  ^  log  1 


+  I  log  (1  +  +  ^-[(Y+i-r)'1  -Y"  ]  -  (t+1  )  log(l  +  j) 

-(t+1)  log  i  -  i  log  i  -  j  log  i  -  j  log  (211)  -  . 


Now,  for  M  sufficiently  large  and  all  i  >  M 


(Y+i-r)  >  0  , 


(121)"1  <  1/12 


d  +  IzL)  >  e(Y-r)/(1  +  (Y-r)) 


Consequently, 


( 2ir)  ‘e  “  1 

where  d^x)  is  defined  by  (A. 9), 


r  i-r  , 

n  (Y+j)  (a+i )"'T+  '/i !  * 
1  j=0 

1  JL  JL  4.J_ 

^oY"  12  "  12y  .y-r-x-1  ”Y+  12  .  , 


y  ,ftd,(t)  , 


IM  >  k  l  iY-r“T-]  , 

M  "  i>M 

where  k  =  k(y,x,r)  is  a  positive  constant.  Thus  1^  diverges  whenever 
y-r-x  >_  0  and  thus  diverges  whenever  e+x  ^0,  establishing  the  theorem. 
Remark.  The  above  analysis  permits  us  to  readily  estimate  the  tail  of  the 
series  whenever  b+t  >  0,  since 
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APPENDIX  II 


In  this  appendix,  we  obtain  a  complete  asymptotic  expansion  (n+<“)  of 

In(a,g,y)  =  Ra+y-1 (1-R) e_1 (-log  R)ndR  , 

where  y  =  ny,  y  >  0.  In  particular,  we  establish  the  following  theorem. 

Theorem  A.  2.  For  y  >  0,  a  >  0,  as  n  -*•  «,  for  any  5  >  0,  k  =  2,3,... 

M  k  ,  .  . 

e  n  n  I  (a,e,y)  =  /2ir/Y  (  l  K(r>(6  )u  /Y  r/2 ) 

n  n^„n,knrn  ' 

r=0 


+  0  In 


k+1  1  A 

—  '  2  ^ 


(A. 14) 


where 


M^(0)  =  0(a+ny)  -  n  log  0  -  (B-l)log(l-e 


and  0  is  the  largest  positive  root  of  M'(0)  =  0.  Further, 


Yn  =  n 


n 

■k  -  ^llw'6"V2  -  (i-.'8"'”1 


n/(f>.  2t/2. 


r  even 


(A. 15) 


(A. 16) 


0  , 


r  odd 


(A. 17) 


and 


,(r>, 


Zl  3 

i..(3) 


k'T  (0 )  =  £(-i)  m'  '(0) 

nk  n 


(k)  k  *3  V 

M  *  |9)/t  l"i  1  31  •••k)  K 

n  3  k 


(A. 18) 


where  the  sum  extends  over  all  l  ,...,£  >  0  with  J  j£.  =  r 

3  k  j=3  3 

In  order  to  prove  Theorem  A. 2,  it  is  desirable  to  introduce  a  number  of 
preliminary  lemmas. 

Lemma  A. 1 .  For  j  =  1,2,..., 

=  (<*+ny)6  +  -  1  -  ^  1 *  —  -  (0-1)  I  b.  ,  ( 1-e  9)  2  ,  (A. 19) 


where  5^  =  1,  <S  ^  .  =  0 ,  j^l  and 
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b01  •  bn  ■  '•  blj  ■  1  >  1  ot  *  <  0  • 

,j-,.  «  <  1  ‘  )■  )  >  2  • 


Alternatively,  we  can  write 


(A. 20 ) 


n 

where 


03 


l  a£je  (l-e  ~6)“j  , 


1=1 


(A. 21 ) 


*11  =  ^  *0j  =  °'  ajj  =  0,  j  >  1,  a,.  -  0,  1  >  j 

al,j+1  "  "£alj  “  (3-a+1^i-1fj  '  1  *  1  <  3  >  2  . 


Further,  for  j  >  2 


(A. 22  ) 


nil^lLL.  |e-i|e‘9(1-e"e)-j(j-1).  <  |M(j)(0)|  <niii±li 


03 


03 


+  IB-1 |e“0(1-e'6)"j( j-1 )  I 
and  for  n  sufficiently  large,  for  each  fixed  9 


nil --111  <  |m(3)(0)|  <  IzilzUl  . 


20- 


0- 


(A.23 ) 


(A. 24) 


Proof.  (A. 19),  (A. 20),  (A. 21)  and  (A. 22)  are  easily  verified.  From  (A. 22), 
it  is  evident  that  sgn  a^  =  (-1)3+1,  j  >  1,  1  4  1  4  j.  Further 


al  i+1  =  J  ("ia£i)  “  ^  (j-H-l)a.  i 

1=1  *'3+1  ^  *3  *=! 


A 


1=0 


[la^  +  (j-l)a 


h 


..  -  I 


1=0 


Ij  ‘ 


Thus 


1=0 


a4.  =  (-1)3+1c(j-1)l 


for  some  constant  c.  Since  a^  =  1,  it  follows  that  c  =  1,  and 


J  a,.  =  (-1)j+1(j-1)!  . 

1=0  3 


(A. 25) 


Thus,  from  (A. 25),  we  have 
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i  _46  _e  -i ,  -9  -0  -i 

|  l  a.  .e  (1-e  )  <  e  ( 1-e  )  ](j-1)l 

A- 1  3 


(A. 26) 


(A. 23  and  (A. 24)  follow  directly  from  (A. 26),  establishing  the  lemma. 

* 

Lemma  A. 2.  A  sequence  of  asymptotic  (n***)  estimates  of  0^  is  provided  by 


0  =  0.  +  0 ( n  ),  i  =  1,2,... 

n  i 


(A. 27) 


where 


0,  =  Vy  , 


(A. 28) 


and 


82  / 

0  =0  +  -±  (  £-  +  Jhl — 

1+1  1  n  U  -6 

1  1-e  1 


ny  -  (a+fr 


-1 


(A. 29) 


Proof.  For  every  e  >  0,  there  is  an  n  sufficiently  large  so  that  M^tO) 

* 

is  strictly  convex  on  (e,00).  Thus,  M^(0)  =  ®  has  a  unique  root  0^  on 
(e,“).  (A. 27),  (A. 28)  and  (A. 29)  follow  readily. 


Specifically, 

*  1  -1 

e  =  -  +  0(n  ’) 
n  — 

y 


- (a+0-1 ))  +  0{n"2) 


y  ny  v^g-Vy 


=  -  + 

-2 

y  ny 


— - (a+0-1 )]  +  1 


-1/y 

( B-1)e  '/J  I  0-1 


1-e 

-1/y 


2-3 
n  y 


£J-_-  (a.6-1)]2 


1-e 


-1/y 


n2y4( 1-e_1/^)2 '  V 


-Vy 


-  (a+0-1 ) j  +  0(n-3) 


(A. 30) 


Remark:  Applying  lemma  A. 2,  and  letting  0=0  in  (A.23),  we  can  deduce 


n(j-1)!/20*2  <  |M(j)(0*)|  <  2n(j-1)i/0*5  . 

n  n  n  n 


(A. 31 


Lemma  A. 3.  For  0  <  r  <  k,  k  >  2, 


=  i 

nk  n 


(A. 32  ) 
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K^<<> 


0,  r  ■  1,2 


<  V(2n)r/3  ?r,  r  -  3.4 . k  , 

for  n  sufficiently  large. 

Proof .  From  (A. 18),  (A. 32)  and  (A. 33)  follows  trivially.  Therefore 
only  establish  (A. 34).  From  (A. 24)  and  (A. 18),  for  n  sufficiently 
3  <  r  <  k. 


|x(*>(fl)|  <  s(-n~12) 

nK  gj 


2n( 2  I )  ■>  3.  / 2n ( k- 1 )  1  }  k 


0 


i  l 

k  )  V*3  1  * •  * *k 1  31  “*k‘ 


Zl 


£tilji~/S,"',k1 3  '••• k 
0  3 


V  A 


Since 


we  have 


I  j*4  *  *  * 

j-3  3 


3  I  vr 

j-3  3 


and 


Thus 


Now 


I  l,  <  r/3  . 

j-3  3 


r/3  L  t 

|Kl5,(0)|  <  — -  El/Jl,  l •  •  *4.  l  3  ***k  n 

nk  gr  3  k 


*k  lr/3]  , 

Ei/t, «•••*.  I  3  3**’k  <  I  rr  l 


ml 


-i  -1  t3..r.,tk»  v-v  3 

^rr3^  11  1m 

)  —  (-  +•••+  -) 
ml  3  k' 

m**1 


<i»‘3. 


<  I  <log  k)m  “  k  • 

m«*1 


(A. 33) 

(A. 34) 

we  need 
large, 


(A. 35) 


Thus 
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lKnk)(9)1  ^  *t(2n)r/3/0r  * 

♦ 

From  (A.31),  the  conclusion  follows  readily  upon  replacing  0  by  0^  in 
(A. 35). 


We  now  proceed  to  the  proof  of  the  theorem, 

-0 

Proof .  Let  R  =  e  obtaining 

t  a  \  "6(°+ny)r,  -0'l6-1Bn  „ 

I  (a,8,y)  =  J  e  [1-e  J  0  d0  . 


(A. 36) 


Let 


g( 0 )  =  e-9(a+ny)(l-e'0Je"10n  . 


(A. 37) 


Choose  T^n),  *2(n)  80  that 


0  <  T  (n)  <  n/ ( a+ny )  <  yn)  <  » 


For  8  >  1, 

t  (n)  Ti<n>  -T  (n)  (a+ny) 

Jq1  g(0)d0  <  /0 1  e"  (  ny)0nd0  <  (T^n))0  ’e  1 


(A. 38) 


(A. 39) 


-0  “T1 

For  6  <  1,  since  1-e  *  0(1-e  )/T  ,  0  <  0  <  , 


1 


whenever 


we  have 


yn)  < 


n+B-1 


a+ny 


Ti(n)  f,  „ 

/„  9(«)d0  <  — f 


-yn)' 


(n)  I  1 


+B  -yn>  (a+ny) 
T(n)  e 


(A. 40) 


proceeding  similarly,  we  have, 

£,<»>  ‘  *181  /T2,n)  e"0<a+ny,end9  . 

where 

f (8)  =1  ,  8  >  1 


f  (8)  =  |^1-e 
From  F.  W.  J.  Olver  [7],  p.  70,  we  have 


-T2(nA  8-1 


I  ' 


8  <  1  . 
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I"  -9  (a+ny )  9T1  q 


,  -  -n-1  r®  -u  n 

(a+ny)  J<*+ni)T2(n)e  U  du 

-(a+ny )T  (n) 
e  (t  (n)> 

<  - - -  . 

(a+ny)T2(n)-n 


Hence 


/;  ,n)9(9,de  < 


-  (ot+ny)  t  (n)  , 

f ( 3) e  2  (T2(n))n+1 

(a+ny)t2(n)-n 


From  (A. 15)  and  (A. 36),  we  have  that 


„  (9) 

I  (a,6,y)  =  /  e  n  d9 


Now  write,  for  k  >  2 


.  ( 9-6* ) 2  ,  (0-6 

M  (9  )  +  ■■  n  ■  M" ( 6  )  +•••+  M<k) 


M  (9)  ...  . 

n  n  n  21  n  n 

+  W  .  (6)  , 

nk 


kl  n  n 


where 


|  0-9 


,  k+1 


'V611  <  -iiirrr- 

* 

and  £  lies  between  9  and  0  . 
n  n 

*  _ 

From  (A. 30)  or  (A. 15),  it  is  easily  seen  that  9  =  n/(a+ny)  - 

thus  for  sufficiently  large  n. 


T  (n)  <  9  <  T  (n)  . 

i  n  2 

Consequently  for  9  e  (T^(n),  T2(n)),  from  (A. 24)  and  (A. 44), 

.k+1 


(t  (n)-t  (n))* 
|Wnk(9)'  <  “  (k+iTT 


/  2nk  l\ 

\Ck+ij 


Now  write  g(9)  as 


*  yn  *  2  *  i 

-W  -  r<9-9  >  -  *  (9-e„)  . 


-W  ,  (9) 
nk 


(A. 41 ) 


(A. 42 


(A. 43) 


(A. 44) 


o(1)  and 


(A.  .45) 


(A. 46) 
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where  Y  =  M”(9  ).  Then  write 
n  n  n 


“  ,  .1*  k  (0"0r,>A  *  r 

'v) 

r=0  X=3 


(-1) 


(0-6  ) 
r!  n 


*  3S+,*‘+kV(3)J* 


*k 

,{k>,  * 


'M 1  '  (  8  )...M,a'(8  ) 

n  n  n  n 


a  rl  o  o  ^a  ^  l 

r*0  t • « • / 3  k 


£  £ 

3  k 

31  •••ki 


(-I)- 


1-  I  I 


^*3  ^3^  *  *  #^]( 


i(e-e*)*  n  (m<3>(6*)\  3 
n  1=3  l  n  nJ 

k  k  £. 

n  i. i  n  ji  3 

j=3  3  j=3 


(A. 47) 


where  the  sum  is  over  £,•••,£  >  0  with  £j£.  =  £•  Thus,  we  can  write 

j  k  i 

(A. 47)  as 


1+  2  Kik)(6l)(0“en)£  +  ^  KiJ>(9J(0-0J4  « 


£=3 


£=k+1 


nk  n  n 


(A. 48) 


where 


I 


I  <-i>stj  n  (m(3)(0*)]  j/  n  £.i  n  ji  3 

j-3  l  n  nl  j=3  3  3=3 


£j >  •  •  *'^k 


Accordingly,  we  define 


(A. 49) 


*  1  n  *  5 

-M  (0  ) - — ( 0-0  )  k 

h  (0)  =  e  n  n  2  n  (l  +  [  Kn^>(0-0n)t)  ' 

K  £=3  nK  n 


(A. 50) 


and  consider 


M(  9* )  „ 

n  n  . 


e  l,(  g(9)d0  -  /_.  hk(0)d0|  =  R> 


(A. 51 ) 


Then 
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M  (6  )  T  (n)  T  (n)  T  (n) 

R*  «  e  "  "  \<0)d0  +  fQ  g(9)d0  +  //{n)|hk(e)-g(0)|d0 


*  *  ^2<n>V9|a9> 


(A. 52) 


From  (A. 34),  we  have 


|1  +  I  K^>(6"en)4*  <  1  +  k  l  (2n)i/3  £*(0-0*)* 
A-3  **  n  Jt=3  ” 


Thus  for  x  (n)  >  9  , 

2  n 

*  *  2 

M  (0  )  „  .  -  “( 6-0  r  k  ...  *  , 

•  "  <»>  V9’39  '  'V„>  9  (’  ♦  J  ^’<9-9„)  )»9 
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Then,  applying  (A. 31)  with  j  *  2,  and  (A. 41) 
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*  l 


k  941/3  fwn,"02) 

r  2 _  W  n  2  n  J 
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r  ‘V-V2-  ¥ 


the  last  inequality  following  from  inequalities  for  the  incomplete  gamma 
function  on  pages  66  and  70  of  F.  J.  Olver  [7]. 
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Similarly, 
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Consequently,  there  is  a  constant  c^  -  such  that 


M  (0* ) 
n  n 


l  26-2  A 

_  c,  -  -n  y  /  4 

v>*l < tff 

2 


(A. 54) 


Similar  calculations  establish  the  same  bound  for 
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From  (A. 44)  and  (A. 31)/  for  sufficiently  large  n. 
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for  sufficiently  large  n.  Similarly 
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From  (A. 37)  and  (A. 40) 
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where  dg  ■ 
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Cor  n  sufficiently  large,  we  can  write 
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where  d^y.B)  does  not  depend  on  n.  Similarly, 


(T^n))  r(Tj  (n) )/  | 


(A. 62) 


C<n,*< °'de  <  — b 


f  (6)  -(ot+ny)Yn> 


(a+ny)*t2(n)-n 


(A. 63) 


where 
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Note  further  that 
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Therefore,  combining  (A.62),  (A.63),  and  (A.64),  we  can  write 
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where  c  is  a  suitable  constant.  Accordingly,  we  consider  the  expression, 
for  i  =  1,2, 
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for  n  sufficiently  large. 


Combining  (A. 52),  (A. 54),  (A.60),  (A. 67)  and  (A .68),  we  have 
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thus  establishing  the  theorem. 
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APPENDIX  III 

From  the  results  of  Appendix  II,  the  various  estimates  of  section  2  all 
have  asymptotic  estimates  given  by  ratios  of  the  form, 
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We  now  proceed  to  obtain  an  asymptotic  expansion  for  this  ratio. 
Since  h^t0)  1148  the  form 


*  n  *  2 

-M  (6  )-  0-0  )*  k 

n  n  2  n 


[  K  ( 6* ) ( 0-0*  ) r 


r=0 


r  n  n 


we  have 


/!«  V0}d0 


-M  (0*) 
n  n 


r  I  <V'W\r/2 

n  r=0 


where  U are  the  central  moments  of  the  normal  distribution  with  variance 
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We  now  employ  the  results  of  Appendix  II  to  evaluate  (A. 71).  From  (A. 15) 
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Using  (A. 30),  direct  calculations  establish 
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Now  write 
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and 
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Finally,  we  set  k  =  5,  obtaining 
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From  (A. 19),  (A. 30)  and  (A. 79),  we  see  that 
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Combining  (A. 71),  (A. 76),  (A. 77),  (A. 78),  (A. 79)  and  (A. 80),  we  have 
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